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Abstract 

We study the asymptotic behaviour of a d-dimensional self-interacting random walk 
{Xn)neN := {1, 2, 3, . . .}) which is repelled or attracted by the centre of mass Gn = 

Y17=i -^i of previous trajectory. The walk's trajectory {Xi, . . . , X„) models a 
random polymer chain in either poor or good solvent. In addition to some natural 
regularity conditions, we assume that the walk has one-step mean drift 

E[Xn+i - X„ I X„ - G„ = x] « p||x|r^x 

for p € M and /3 > 0. When /3 < 1 and p > 0, we show that X„ is transient with a limit- 
ing (random) direction and satisfies a super-diffusive law of large numbers: n~^^^^^^^ Xn 
converges almost surely to some random vector. When /3 € (0, 1) there is sub-ballistic 
rate of escape. For /3 > 0, /? € M we give almost-sure bounds on the norms ||^n||) which 
in the context of the polymer model reveal extended and collapsed phases. 

Analysis of the random walk, and in particular of A„ — G„, leads to the study of 
real-valued time-inhomogeneous non-Markov processes {Zn)neN on [0, oo) with mean 
drifts of the form 

E[Z„+i -Zn\Zn = x]^ px-^ - -, (0.1) 

n 

where /3 > and p € M. The study of such processes is a time-dependent variation on 
a classical problem of Lamperti; moreover, they arise naturally in the context of the 
distance of simple random walk on from its centre of mass, for which we also give 
an apparently new result. We give a recurrence classification and asymptotic theory 
for processes satisfying (lO.ip . which enables us to deduce the complete recurrence 
classification (for any /3 > 0) of X^ — Gn for our self-interacting walk. 
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1 Introduction 

We study a self-interacting random walk. Self-interacting random processes, in which the 
stochastic behaviour depends on the entire previous history of the process, present many 
challenges for mathematical analysis (see e.g. [ll|3l] and references therein) and are often 
motivated by real applications. 

Although not a random process in the same sense, the self-avoiding walk is a prototypical 
example of a self-interacting random walk that gives rise to important and difficult problems. 
Random self-avoiding walks were introduced to model the configuration of polymer molecules 
in solution. The sites visited by the walk represent the locations of the polymer's constituent 
monomers; successive monomers are viewed as connected by chemical bonds. The classical 
self-avoiding walk (SAW) model takes uniform measure on n-step self-avoiding paths in Z*^. 
In the important cases of (i G {2,3}, there are still major open problems for such walks: 
see for example [26l|28] and [T7| Chapter 7], or [371 Chapter 7] for a mathematical physics 
perspective. 

The loop-erased random walk (LERW), obtained by erasing chronologically the loops of 
a random walk, was introduced in [2l] to study SAW, but it was soon realized that the 
two processes belong to different universality classes. For its independent interest, including 
applications to combinatorics and quantum field physics, LERW has received considerable 
attention and now there is a more precise picture of its behaviour, which shows fine depend- 
ence on the spatial dimension. In the planar case, the mean number of steps for LERW 
stopped at distance n is of order n^^^ [2D], and the scaling limit is conformally invariant, 
described by the radial Schramm-Loewner evolution with parameter 2 [25] . 

A different perspective on polymer models concerns directed polymers, where the self- 
interaction is reduced to a trivial form but interesting phenomena arise from the interaction 
with the medium: see [13|[T6] for recent surveys for localization on interfaces (pinning, 
wetting) possibly with time-inhomogeneities (e.g. copolymers), and [2] for interactions with 
a time-space inhomogeneous medium leading to localization in the bulk. 

In the standard framework, SAW cannot be interpreted as a dynamic (or progressive) 
stochastic process. There have been many attempts to formulate genuine stochastic processes 
with similar behaviour to that of, or at least conjectured for, SAW. A recent model is the 
random walk on which at each step avoids the convex hull of its preceding values [2||39]. 
Unlike the conjectured behaviour of SAW, this model is ballistic (see [21132]), i-e., it has a 
positive speed. The discrete version on Z^, the dynamic prudent walk, has been studied 
in [5]: it is ballistic with speed 3/7 (in the norm), but, in contrast to the (conjecture for 
the) continuous model, it does not have a fixed direction (see [5]). Ballisticity is known for 
other types of self- interacting random walks: see [ZllIH] • 

In this paper we consider a self-interacting random walk model that is a tractable altern- 
ative to SAW, and is distinguished from the models [21 El [Zl [121121] by exhibiting a range of 
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possible scaling behaviour, including sub-ballisticity (i.e., zero speed) and super-diffusivity. 
Our model is tunable, with parameters that in principle can be estimated from real data, and 
it can be used to represent polymers in the extended phase (for good solvent) or collapsed 
phase (poor solvent). The self-interaction in the model at time n is mediated through the 
barycentre or centre of mass of the past trajectory until time n. Specifically, our random walk 
will at each step have a mean drift (typically asymptotically zero in magnitude) pointing 
away from or towards the average of all previous positions. We now informally describe the 
probabilistic model; we give a brief description of the motivation and interpretation arising 
from polymer physics in Section 13.31 



Let d e N := {1,2,3, . . .}. Our random walk will be a discrete-time stochastic process 
X = {Xn)n€N ou M"^. For n G N, set 



the centre of mass (average) of {Xi, . . . In addition to some regularity conditions on 

X that we describe later, our main assumption will be that the one-step mean drift of the 
walk after n steps is of order — in the direction ±(X„ — G„), where /3 > is 

a fixed parameter; here and subsequently || ■ || denotes the Euclidean norm on M'^. Loosely 
speaking for the moment, we will suppose that for some p G M and /3 > 0, 



for any G N and x G M'^ \ {0}, where x := x/||x|| denotes a unit vector in the x-direction 
and is the origin in M.'^. We attach no precise meaning to '~' in (11. 2p (or elsewhere); it 
indicates that we are ignoring some terms and also that we have not yet formally defined all 
the terms present. We describe the model formally and in detail in Section |2] below. 

The natural case of our model to compare to the walk that avoids its convex hull [2|[39] 
has P = and p > 0, when our walk has positive drift away from its current centre of 
mass. In our /3 = 0, p > setting we show that the walk has an asymptotic speed and 
an asymptotic direction, properties which are conjectured but not yet proved for the walk 
avoiding its convex hull [2l[39]. Our results however cover much more than this special case. 
For example, the case of our model that we might expect to be in some sense comparable to 
SAW in d = 2 has (3 = 1/3, p > 0: see the discussion in Section [373] below. 

To give a flavour of our more general results, described in more detail in Section 12.21 
below, we now informally describe our results in the case where (11. 2p holds with p > and 
(3 G [0, 1). Under suitable regularity conditions, we show that X is transient, i.e. \\Xn\\ — )■ oo 
a.s., and moreover we prove a strong law of large numbers that precisely quantifies this 
transience: n"^/'-"^'*'^^ ||X„|| is asymptotically constant, almost surely. In addition, we show 
that Xn has a limiting direction, that is, X„/||X„|| converges a.s. to some (random) unit 
vector. Thus we have, in this case, a rather complete picture of the asymptotic behaviour of 
Xn- For other regions of the (p, /3) parameter space we have other results, although we also 
leave some interesting open problems. 

The self-interaction in the model is introduced via the presence of Gn in (11. 2p . If the 
condition {Xn — Gn = x} in (II. 2p is replaced by {X„ = x} then there is no self-interaction 




(1.1) 



i=l 



E[X„+i -Xn\Xr,-Gn = ^]^ PM'"^, 



(1.2) 
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in the drift, which instead points away from a fixed origin. Such non- homogeneous 'centrally 
biased' walks were studied by Lamperti in [2T1 Section 4] and [231 Section 5]; for more recent 
work see e.g. fT ^ ITT t lHT]. Considering the process of norms Z„ = leads to a process on 

[0, oo) with mean drift 

E[Z,+1 -Zn\Zn = x]^ p'x-^ (1.3) 

ignoring higher-order terms. Such 'asymptotically zero-drift' processes are of independent 
interest; the asymptotic analysis of such (not necessarily Markov) processes is sometimes 
known as Lamperti's problem following pioneering work of Lamperti [2TI - I23] . From the point 
of view of the recurrence classification of processes satisfying (11. 3p . the case /3 = 1 turns out 
to be critical, in which case the value of p' G M is crucial: we give a brief summary of the 
relevant background in Section 13.11 below. 

We shall see below that considering the process Z„ = — CnH with X„ satisfying (ll.2p 
leads to a more complicated form of (II. 3p . Loosely speaking, we will obtain 

E[Z„+i -Zn\Zn = x]^ p'x-" - ^. (1.4) 

We note that the two terms on the right-hand side of (ll.4p are typically of the same order, as 
can be predicted by solving the corresponding differential equation, and so both contribute 
to the asymptotic behaviour. 

Comparing (II. 4p with (II. 3p . we see that the drift is now time- as well as space-dependent. 
(A different variation on (ll.3p with this property was studied in [30], where processes with 
drift px"n~^ were considered.) Thus (ll.4p is an interesting starting point for analysis in its 
own right. Additional motivation for (ll.4p arises naturally from simple random walk (SRW) 
and its centre of mass: if Zn = — Gn\\ where Xn is a symmetric SRW on Z*^ and G„ its 
centre-of-mass as defined by (II. ip . Zn satisfies (ll.4p with (3 = 1 and p' = p'{d); see Section 
EJ below. 

Let us step back from the general setting for a moment to state one consequence of our 
results, which is a (seemingly new) observation on SRW: 

Theorem 1.1. Let c/ G N. Suppose that (X„)„gN is a symmetric SRW on if" , and (G'ri)neN 
is its centre-of-mass process as defined by U.l\) . Then 

(a) liminf^^oo \\^n — Gn\\ < oo a.s. for d G {1,2}; 

(b) lim„_>.oo ll^n — Gn\\ = oo a.s. for d > 3. 

Polya's recurrence theorem says that X„ is recurrent in d < 2 and transient in d > 3, 
while results of Grill say that the centre-of-mass process is recurrent only in ci = 1 
and transient for d >2. Thus the asymptotic behaviour of X„ — Gn is not trivial; Theorem 
11.11 says that it is recurrent if and only if (i G {1,2}. In particular when d = 2, Xn and 
Xn — Gn are both recurrent, but Gn is transient; see Figure [1] for a simulation. 

Remark 1.1. Theorem \l.l\ exhibits an amusing feature. With the notation := Xn+i — Xn 
it is not hard to see from M.l\) that we may write (with Xq .= 0) 
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It follows that (for fixed n ) X„ — and Gn are very nearly time-reversals of each other: 
writing A'- := A„_j we see that 

i=l ^ ^ 

Despite this, the two processes behave very differently, as can be seen by contrasting Theorem 
{T^wzth Grill's result fl^. 

It is natural to ask whether a continuous analogue of Theorem 11.11 holds. In the one- 
dimensional case, we would take Bt to be standard Brownian motion and Gt = t~^ Bgds, 
and ask about the joint behaviour of {Bt, Gt)] in higher dimensions, writing the d- dimensional 
Brownian motion as (sf \ . . . , 5^ )), the ith component of Gt is t-' /J Bi'^ds, and differ- 
ent components are independent. We could not find a Brownian analogue of Grill's theorem 
for (compact set) recurrence/transience of explicitly stated in the literature. The process 
{tGt)t>o is integrated Brownian motion, or the Langevin process, see e.g. [31IT9] and references 
therein. The two-dimensional process {Bt,tGt)t>o is the Kolmogorov diffusion [TH]. Theorem 
11.11 gives basic information about the joint behaviour of a discrete version of this process, 
under a re-scaling of the second coordinate. 

In Section [2] we formally define our self-interacting random walk and state our main 
results. In Section [3] we discuss some more of the motivation behind our model (coming 
from the physics of polymers and also purely theoretical considerations) and also the one- 
dimensional problems associated with (11.31) and (II. 4p . and explain how SRW (and Theorem 
II. ip fits into our picture. The subsequent sections are devoted to the proofs. 

We finish this section with some comments on the relation of our model to the existing 
literature. We are not aware of any self-interacting random walk models similar to the one 
studied here (i.e., interacting with the previous history of the process, as summarized through 
the barycentre). In broad outline, our model is related to the vertex- reinforced random walk 
(see [Ml Section 5.3]) in that the evolution of the walk depends on the sites previously 
visited. A significant difference is that in vertex-reinforced random walk this self-interaction 
is local, in that only the occupation of nearest-neighbours of the current site affects the law 
of the increment, whereas our interaction, mediated by the barycentre, is global. In the 
continuous setting, self-interacting diffusions (or 'Brownian polymers') with similar flavour 
and motivation to those of our model have also been studied over the last two decades or 
so, but are rather different in detail to the model considered here: see e.g. [11[TT],[32],[33] and 
references therein; some recent work on processes with self-attracting drift defined through 
a potential includes [6]. In the self-interacting diffusion setting, most of the results in the 
literature are concerned with the ergodic case; questions of recurrence/transience seem to 
have received little attention (particularly in dimensions greater than 1), and we do not 
know of any results on asymptotic directions. Also, it is typically assumed that the vector 
consisting of the process and its empirical average are Markovian, whereas our model is more 
general. See [32l Section 1] for a short survey. 
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Figure 1: Simulation of 4 x 10^ steps of symmetric SRW starting at the origin of 1? (path 
shown in red) and its centre of mass process (blue). 

2 The model and main results 
2.1 Definitions and assumptions 

We now define the stochastic process X := {Xn)nm on M'^ {d G N) that is our main object 
of study. (We start at time n = 1 only so that (11. ip has the neatest form.) The process 
X will not be Markovian, as the distribution of X^+i will depend on the entire history 
Xi, . . . , Xn, although to a large extent this dependence will be mediated through the current 
centre of mass defined at (II. ip . Formally, we suppose that (X„)„gN is adapted to the 
filtration (J-'„)„gN; note that by (II. ip Gi, . . . ,Gn are measurable. We use the notation 
P„[-] := P[- I J^n] and ]E„[-] := E[- | J^n]- Throughout the paper we understand logx to 
mean logx if x > 1 and otherwise. 

We impose some specific assumptions on the law of A„ := Xn+i — Xn given J^n- We 
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assume that for some B G (0, oo) and all nGN, 

Pn[||A„||<5] = l, a.s.. (2.1) 

The assumption of uniformly bounded jumps can be replaced by an assumption on higher 
order moments at the expense of additional technical complications, but (12. ip is natural 
when the increments represent chemical bonds in a model for a polymer molecule. 

Our next assumption will be a precise version of (II. 2p . We suppose that for some p G M 
and (3 > 0, for any nGN, writing x = X„ — Gn for convenience, 

E„[A„] = p||x||-^x + 0(||x||-''(log ||x||)-2), a.s., (2.2) 

as ||x|| — )■ oo, where x := x/||x||. (In (12.20 the exponent —2 on the logarithm is chosen for 
simplicity; it could be replaced with any exponent strictly less than —1.) In equation (12.20 
and similar vector equations in the sequel, terms such as 0(- ) indicate the presence of a 
vector whose norm satisfies the given 0( ■ ) asymptotics (similarly for o( ■ )); error terms not 
involving n are understood to be uniform in n. To be clear, (12. 2p is to be understood as, 
with Xn — Gn = X, as ||x|| — )■ oo, 

sup ess sup ||E,,[A„] - p||x||-^x|| = 0(||x||"'^(log ||x||)"2). 

nGN 

We also need to assume a uniform ellipticity condition, to ensure that our random walk 
does not get 'trapped' in some subset of M.'^. Let Sd := {e G : ||e|| = 1} denote the 
unit-radius sphere in M"^. We suppose that there exists Eq > such that 

essinfP„[A„-e>£o] >£o- (2.3) 

Write An = {A^n\...,Ai^^) in Cartesian components. An immediate consequence of 
(12. 3p is the following lower bound on second moments: a.s., 

. min E„[(A«)2]>2e3>0. (2.4) 

..,d} 

Our primary standing assumption will be the following. 

(Al) Let d E N. Let X := {Xn)n£N be a stochastic process on M"' and G := {Gn)nm its 
associated centre-of-mass process defined by (11.11) . For definiteness, take Xi G M'* to 
be fixed. Suppose that for some 5 < oo, > 0, p G M, and f3 > the conditions 
CT . (O, and hold. 

In the examples discussed later (see Section [2l3l) . {Xn,Gn)neN will be a Markov process, 
but we do not assume the Markov property in general. 

When /3 = 1, as in the Lamperti case [21],[23] the value of p in (12. 2p will turn out to be 
crucial. As in Lamperti's problem, the recurrence classification depends on the relationship 
between p and the covariance structure of A„. To obtain an explicit criterion, we impose 
additional regularity conditions on that covariance structure. Specifically, we sometimes 
suppose that (a) there exists cr^ G (0, oo) such that, a.s., 

E„,[(A«)2] =a' + o((log - Gjr'), (z G {1, . . . , d}); (2.5) 
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and (b) for i,j distinct elements of {1, . . . , d}, a.s., 

E„[A»A(f)] = o((log - (2.6) 
Thus for /3 > 1, when necessary we will impose the following additional assumption. 
(A2) The conditions ([23]) and (EJl) hold for some cr^ g (o, oo). 

2.2 Results on self-interacting walk 

Our first result, Theorem 12. 1^ constitutes the first part of our complete recurrence classific- 
ation for Xn — Gn- Since we are dealing with non-Markovian processes, we first formally 
define what we mean by recurrence and transience in this context. 

Definition 2.1. An W^-valued stochastic process (Cn)neN said to he recurrent if 
liminf^^oo ||^n|| < oo a.s. and transient z/lim„^oo ||^n|| = oo a.s.. 

Define 

Po:=p^{d,a^):=]^{2-d)a\ (2.7) 

Theorem 2.1. Suppose that (Al) and (A2) hold with d G N, /3 > 1, and p G M. 

(i) Suppose that (3 = 1. Let po = po{d,a'^) be as defined at \2. 7| j. Then Xn — Gn is 



recurrent if p < po and transient if p > Po- 
(a) Suppose that /3 > 1. Then Xn — Gn is recurrent if d & {1, 2} and transient if d > 3. 
For almost all our remaining results we do not need to assume (A2). Set 

<(p.«-(^) . (2.8) 

In the case /3 G [0, 1), we have the following result, which completes the recurrence classi- 
fication for Xn — Gn and also gives a detailed account of the asymptotic behaviour of the 
random walk X„. In particular, when p > 0, Xn and Gn are transient, and moreover have a 
limiting direction, and the escape is quantified by super- diffusive but, for /3 > 0, sub-ballistic 
strong laws of large numbers. The case /3 = shows ballistic behaviour. 

Theorem 2.2. Suppose that (Al) holds with G N, /3 G [0,1), and p e R \ {0}. Then 
Xn — Gn is transient if p > and recurrent if p < 0. Moreover, if p > 0, there exists a 
random u G such that, as n ^ oo, with i{p, (3) defined at \2.8) . 

^ (2 + /3)£(p, /3)u, and n-^'^^+^^Gn ^ (1 + /3)£(p, /3)u. 

At the level of detail displayed by Theorem 12.21 we can see a difference between the 
asymptotic behaviour of the /3 G [0,1), p > case of (12.21) compared to the 'supercritical 
Lamperti-type' case in which the drift is away from a fixed origin (i.e., the analogue of (12.21) 
holds but with x = Xn rather than x = Xn — Gn)- See Theorem 12.51 below and the remarks 
that precede it. 

Our ultimate goal is a complete recurrence classification for the process Xn- Theorem 
12.21 covers the case /5 G [0, 1), p > 0. Otherwise, we have at the moment only the following 
one-dimensional result (to be viewed in conjunction with Theorem 12.11) . 
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Theorem 2.3. Suppose that (Al) holds for d = 1. Then if — Gn is transient, X„ and 
Gn are also transient, i.e., — oo and — t- oo a.s. as n ^ oo. 

Our final result on our walk with barycentric interaction gives upper bounds on ||X„|| 
for general c? G N. In view of the interpretation of (Xi, . . . as a model for a polymer 
molecule in solution, we can describe the phases listed in Theorem 12.41 below as (i) extended, 
(ii) transitional, (iii) partially collapsed, and (iv) fully collapsed. See the discussion in Section 
l3.3l below. Theorem 12 .4( 1) is included for comparison only; Theorem 12.21 gives a much sharper 
result. Define ^ 

7id,a',p):=(^2-d-^^ . (2.9) 

Theorem 2.4. Suppose that (Al) holds with d & N, P > 0, and p G M. Then the following 
bounds apply. 

(i) (Theorem \2.^ ) If (3 E [0,1) and p > 0, there exists C G (0, oo) such that, a.s., 
\\Xn\\ < Cn^^^^'^^'^ for all but finitely many ?i G N. 

(ii) If (3 > I, then for any e > 0, a.s., < ?7,^/^(logn)(^/^)+'^ for all but finitely many 
n eN. 

(iii) Suppose that (A2) also holds. Suppose that P = 1 and p < — c/cr^/2, and let '-/{d, a^, p) G 
(0, 1/2) be as defined at l\2.9\) . Then for any e > 0, a.s., for all but finitely many n eN, 
||X„|| < n'^id,^^ 'p)+^ , 

(iv) If /3 E [0,1) and p < 0, then for any e > 0, a.s., ||X„|| < (logn)^"^i^"^^ for all but 
finitely many n G N. 

We suspect that the bounds in Theorem 12.41 are close to sharp, in that corresponding 
lower bounds of almost the same order should be valid (only infinitely often, of course, in 
the recurrent cases). However, the lower bounds of [291 Section 4] do not apply directly. 

Given (11. ip it is evident that the bounds for ||X„|| in Theorem 12.41 imply the same bounds 
(up to multiplication by a constant) for HCnll, and hence ||X„ — Gn\\ too. In addition, the 
same upper bounds hold (again up to a constant factor) for the quantities of diameter 
and root-mean-square radius of gyration Rn given by 

Dn:= max \\X,-X,\\, i?^= - ^ - G„f = - ^ - X, Ip; 

these are both physically significant in the interpretation of {X\, . . . , X„) as a polymer chain 
(see pp. 95-96 of [T7] and Section below). 

Finally, we briefly describe how our results compare to the more classical model studied 
by Lamperti [2T1I23]- That is, suppose that (Al) holds but that (12. 2p holds with x = X„ 
instead of'x. = X^ — Gn- In this case, there is no self-interaction in the drift term, and the 
drift is relative to a fixed origin. Lamperti studied examples of such processes (so-called 
centrally biased random walks) in [211 Section 4] and [23l Section 5]. We see that our 
recurrence classification for the self-interacting process X„ — Gn in the case /9 = 1, Theorem 
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I2.H gives, surprisingly, essentially the same criteria as Lamperti's pTl Theorem 4.1]. In the 
case P G [0, 1), the difference between the two settings is clearly manifest in the constant in 
the law of large numbers. The analogue of our Theorem 12.21 in the case of drift relative to 
the origin is an immediate consequence of Theorem 2.2 of [27] with Theorem 3.2 of |31] (see 
the discussion in [311 Section 3.2]): 

Theorem 2.5. I27\l31^ Suppose that (Al) holds, with the modification that Ii2.2^) holds with 
X = Xn instead of = X„ — Suppose that d G N, /3 G [0, 1), and p > 0. Then there 
exists a random u E Sd such that, as n ^ oo. 



n-mi+P)X^ ^ (2 + /3)i/(^+'^)£(p, /3)u, and n~'/^'+^^Gn ^ (1 + /3)(2 + /3)"^/(i+'^)£(p, /3)u. 



The method of proof of Theorem 12.21 in the present paper (see Section 16. 2p gives an 
alternative proof of Theorem 12. 5[ avoiding the rather involved argument for establishing a 
limiting direction used in [27]. Specifically, in the argument in Section [6^ we can apply the 
relevant law of large numbers (Theorem 3.2 of [31]) in place of our Lemma [6.11 Note that 
under the assumption of bounded increments, the law of large numbers [311 Theorem 3.2] is 
available, unlike in the generality of Theorem 2.2 from [27]; thus in the more general setting, 
the proof of [27] is currently the only one that the authors are aware of. 

2.3 Examples 

To illustrate our assumptions and results, we give three examples of walks satisfying (Al) 
and (A2). In all of the following examples, the couple (X„, On) is Markov. 

Example 1. For x G M*^, let bi(x), . . . , h^ix.) denote an orthonormal basis for Mf^ such that 
bi(x) = X, the unit vector in the direction x; we use the convention := ei := (1, 0, . . . , 0). 



Fix eo G (0, l/(2rf)), p G M, and /3 > 0. Take 

P„[A„ = b,(X„ - Gn)] = Pn[A„ = -b,(X„ - G^)] = ^, (2 G {2, . . . , d}), 



and 




Pn[A, 



bi(X, 



Gn)] 



1 



-P„[A„ = bi(X„-G'„)]. 



•n 



n 



d 



In other words, for all — sufficiently large. 



P„|A„ = ±b.(X„-G,.)| = ^±|l|A;.-G^ 



Then writing x = X„ — G„, we have for x G M'^ with ||x|| sufficiently large, a.s.. 



E„[A„] = p||x|r^x; E„,[(A«)2] = - 5^(b, ■ e,)^ = -. 
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It is not hard to verify that (Al) and (A2) (with = l/c?) hold in this case. In particular, 
if /3 = 1 Theorem 12.11 says that Xn — Gn is transient if and only if p > (2 — d)/{2d). See 
Figure [2] for some simulations of this model. 




20 40 



Figure 2: Simulation of 10^ steps of the random walk (red) and its centre of mass (blue), as 
described in Example 1, with d = 2, p = 0.1, Eq = 0.01, and different values of (3 E (0, 1]; the 
three pictures have /3 = 0.1, 0.5, 1 clockwise from the top left. Theorem 12.21 says that in the 
two P < 1 cases, the random walk X„ is transient with a limiting direction. In the /3 = 1 
case, we know from Theorem 12.11 that Xn — Gn is transient (po = here), but transience of 
Xn itself is an open problem. 
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Example 2. Here is another example satisfying (Al) and (A2), this time with jumps 
supported on a unit sphere rather than being restricted to a finite set of possibilities. Let 
P > and p G M. Given and X„ — G„ = x, the jump A„ is obtained as follows. 

(i) Choose uniformly distributed on the unit sphere S^. 

(n) Take A„ = U„ + p||x||~^l{^||x||-,9<i/2}X. 

So the jumps of the walk are uniform on a sphere, but the centre of the sphere is (for ||x|| 
large enough) shifted slightly in the direction ±x, depending on the sign of p. Conditions 
(Al) and (A2) (again with cr^ = 1/d) are readily verified for this example. 

Example 3. We sketch one more example with d > 2, (5 > and p > 0, which is 
reminiscent of the walk avoiding its convex hull. Take the jump A„ uniform on minus 
the circular cap of relative surface p\\Xn — Gnll"^ pointing towards the barycentre, i.e., 

An is uniform on {y G §d : y ■ i > -1 + C(p) ||x||^''/('^^^) } , 

with X = Xn — Gni where C(p) is a constant depending on p and d. Here we assume ||x|| is 
sufficiently large; if not we can take A„ uniform on S^. 

2.4 Open problems and paper outline 

Our results give a detailed recurrence classification (Theorem l2.1l) for the process X„— G„. Of 
considerable interest is the asymptotic behaviour of X„ itself, for which we have a complete 
picture only in the case (3 G [0, 1), p > (Theorem 12.21) . We conjecture: 

• ||X„|| — 7- oo a.s. if and only if — — > oo a.s.. 

Theorems I2.2l and l2.3l verify the 'if part of the conjecture when (i) /3 G [0, 1) and p > 0, and 
(ii) d = 1. Another open problem involves the angular behaviour of our model when /3 > 1. 
By analogy with [27] we suspect that there is no limiting direction in that case (in contrast 
to Theorem 

The remainder of the paper is arranged as follows. In Section |3] we describe in more 
detail how our model is related to Lamperti's problem (Section 13. ip . and to the centre-of- 
mass of SRW (Section 13. 2p . and we prove Theorem 11.11 We also outline the motivation of 
our random walk as a model for a random polymer in solution (Section 13. 3p . Section S] is 
devoted to preliminary computations for the processes X„, G^, and (especially) Xn — Gn- 
In Section |5] we take a somewhat more general view, and study the asymptotic properties 
of one-dimensional, not necessarily Markov, processes satisfying a precise version of (11. 4p . 
The recurrence classification is a time-varying, more complicated analogue of Lamperti's 
results [2T1I2S], and we use some martingale ideas related to those in [T21EI]- In the case 
/3 G [0, 1), p > we prove a law of large numbers that is a cornerstone of our subsequent 
analysis for the random walk Xn- This law of large numbers is an analogue of that in [31] 
for the supercritical Lamperti problem. While the results of [31] supply an upper bound 
crucial to our approach, the law of large numbers in the present setting requires a new idea, 
and our key tool here is a stochastic approximation lemma (Lemma 15. ip . which may be of 
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independent interest. Section |6] is devoted to the proofs of our main theorems. The basic 
method is an apphcation of the results of Section E] to the process \\Xn — Gn\\, armed with 
our computations in Section HI We carry out this approach to prove Theorems 12.11 and 12.31 
in Section 16.11 A crucial ingredient is the proof, in Section 16. 2[ that X„ — Gn has a hmiting 
direction. This enables us to prove Theorem 12.21 Finally, in Section 16. 3[ we prove Theorem 
12. 4[ building on some general results from [29] . 

3 Connections and further motivation 

3.1 Lamperti's problem and simple random walk norms 

Our problem is related to a time-dependent version of the so-called Lamperti problem. We 
briefly review the latter here. Let Z = (Z„)„gN be a discrete-time stochastic process adapted 
to a filtration (J^n)neN and taking values in an unbounded subset S of [0,oo). The set S 
may be countable (as in the SRW example which follows in this section) or uncountable (as 
in the application to stochastic billiards described in [29]). 

Lamperti [2TI - I23] investigated the extent to which the asymptotic behaviour of Z is 
determined by the increment moments E„[(Z„_|_i — Z^)^] when viewed as (random) functions 
of Zn. Formally, suppose that for some k, E„[(Z„+i — Zn)^] is well-defined for all n. Then by 
standard properties of conditional expectations (see e.g. [SI Section 9.1]), there exist a Borel- 
measurable function 4)k{n; ■ ) and an J>^-measurable random variable ipkin) (orthogonal to 
Zn) such that, a.s., 

E„[(Z„+i - Znf] = E[(Z„+i - Znf I Zn] + Mri) = Mn; Z^) + ^fc(n). 

Define 

fik{n;x) := (f>k{n;x) + iJk{n). (3.1) 

The /ifc(?T,;a;) are, in general, J-'„-measurable random variables; if Z is a Markov process 
then ij,k{n;x) = E[(Z„+i — Zn)^ | Z„ = x] is a deterministic function of x and n, and if 
in addition Z is time- homogeneous, fik{n]x) = /ifc(x) is a function of x only. For many 
applications, including those described here, Z will not be time- homogeneous or Markovian, 
but nevertheless the fj,k{'n;x) are well-behaved asymptotically. 

In this section, X = {Xn)nm will be the symmetric SRW on Z*^ {d G N). That is, X 
has i.i.d. increments A„ := Xn+i — Xn such that if {ei, . . . , e^^} is the standard orthonormal 
basis on M'^, for i e {1, . . . , d], P[A„ = e^] = P[A„ = -e^] = {2d)-^ . 

Let J^n = cr{Xi, . . . , Xn) and consider the (J-'„)„gN-adapted process Z = {Zn)nm on 
[0, oo) defined by Zn = ||-^n||- Here Z takes values in the countable set S = {||x|| : x e Z'^}. 
Note that Z is not in general a Markov process: when d = 2, given one of the two J-'„-events 
{Xn = (5,0)} and {X„ = (3,4)} we have Zn = 5 in each case but Zn+i has two different 
distributions; for instance Zn+i can take the value 6 (with probability 1/4) in the first case, 
but this is impossible in the second case. 

We recall some simple facts about A„ = Xn+i — Xn in the case of SRW. We have 

Pn[||A„|| < 1] = 1, a.s., and E„[A„] = 0, a.s.. (3.2) 
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Writing A„ = (An \ . . . , An^) in Cartesian components, we have that 

E„[A«A(f)] = ^l{z = j}, a.s.. (3.3) 
Elementary calculations based on Taylor's expansion and (13. 2p and (13. 3p show that 

1 

E„[Z„+i - Z„] = — ^ (||X„ + e,|| + ||X„ - e,|| - 2||X„||) 

i=l 

in the above notation, /ii(n; x) = — ^) + 0(x~^) as x — oo. As before, this asymptotic 
expression is the compact notation for 

sup ess sup fii{n;x) = — ( 1 ) + 0(x~^), 

together with the same expression with 'inf instead of each 'sup'. Similarly 

1 

Er,.[Zl^, -Zl] = -Y,{\\Xn + e.f + ||X„ - e,f - 2||X„f ) = 1. 

i=l 

Then since {Z^^i — Zn)'^ = Z^^^ — — 2Zn{Zn+i — Zn) we obtain 

E4(Z„+i-Z„)2] = l + 0(||X„|ri). 
In particular, (11. 3p holds (interpreted correctly) with (3 = 1 and p' = (1 — {l/d))/2. 

3.2 Centre of mass for simple random walk 

We saw in Section 13.11 how a mean drift described loosely by (11.30 arises from the process 
of norms of symmetric SRW. In this section we describe how a process with mean drift of 
the form (ll.4p arises when considering the distance of a symmetric SRW to its centre of 
mass. The motion of the centre of mass of a random walk is of interest from a physical point 
of view, when, for example, the walk represents a growing polymer molecule: see e.g. [T] 
and [37], especially Chapter 6. 

The centre-of-mass process (defined by (II. ip ) corresponding to a symmetric SRW on 
Z'^ was studied by Grill [15], who showed that the process (Gn)neN returns to a fixed ball 
containing the origin with probability 1 if and only if d = 1. In particular the process is 
transient for (i > 2 and Grill gives a sharp integral test for the rate of escape of the lower 
envelope. A consequence of his result is the following. 

Theorem 3.1. IT5^ Let {Xn)nm be symmetric SRW on and (Gn)nGN the corresponding 
centre-of-mass process defined by U.l\) . Let d G {2, 3, 4, . . .}. Then for any e > 0, 

\\Gn\\ > (logn)"d^"^ra^/^, a.s., 

for all but finitely many n G N. On the other hand, for infinitely many n 

\\Gn\\ < (logn)~d^n^/^, a.s.. 
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A crude upper bound for HCnll, obtained by applying the triangle inequality ||G„|| < 
n Sr=i °f iterated logarithm for symmetric SRW on Z'^ {d G N) to 

each (see e.g. Theorem 19.1 of [3S]), is that for any e > 0, a.s., 

\\Gn\\ < + e){2nloglogny/\ 

for all but finitely many n G N; it seems likely that this is an overestimate. In d = 1, in the 
analogous continuous setting, a result of Watanabe |3Sl Corollary 1, p. 237] says that, for Bt 
standard Brownian motion, for any e > 0, for all t large enough, 



1 f 

- / B^ds < 3~^^^{1 + e){2tlog\ogtY^^, a.s., 
i Jo 



and this bound is sharp in that the inequality fails infinitely often, a.s., when e = 0. Standard 
strong approximation results show that this result can be transferred to ||Gi|| in d = 1. 

The next result shows how the drift equation (11. 4p arises in this context. Lemma [3. II is 
a consequence of the more general Lemma 14.21 below. 

Lemma 3.1. Let d eN. Suppose that {Xn)nm is a symmetric SRW on Z'^, and {Gn)nm is 
its centre-of-mass process as defined by U.l\) . Let Tn '■= (^{Xi, . . . , X„) and Yn := X„ — Gn- 
Then, a.s., 

- M = (i - i) ^ - + o(i|y„i|-); 
E„I(IIK.«II - l\Yjr-] = 2 + 0(l|i'„l|n-') + 0(||y„||-'). 

Neglecting higher-order terms, the study of the process — Gnll for SRW leads us to 
analysis of a process with drift given by (II. 4p . Lemma [3.11 can be generalized to zero-drift 
Markov chains X = {Xn)nm satisfying appropriate versions of (13. 2 p and ( 13. 3p . We prove our 
results on SRW by applying our general results given in Sections H] and El 

Proof of Lemma This follows from Lemma 14.21 stated and proved in Section SJ Taking 
expectations in (I4.10p and using (13. 2p and (13.30 we obtain the first equation in the statement 
of the lemma, using the fact that ||l^n|| = o{n) a.s. to simplify the error terms. Similarly, 
squaring both sides of (I4.10p and taking expectations we obtain the second equation in the 
lemma. □ 

Proof of Theorem \l.l[ Let Z„ = ll^nll = W^n — Gn\\ and J-'n = cr(Xi, . . . , X„). Then by 
Lemma [3.11 a.s., 

1\ 1 Z, 



E„[Z„+i _ Z„] = (^1 - -J ^ - + 0{n-'Zn) + 0{Z-'y, 

E„[(Z„+i - = 1 + 0(Z„n-i) + 0{Z-'). 

Thus (15. 4p and (15.50 hold with p' = {d — l)/{2d) and cr^ = l/rf. It follows from Theorems 
15.11 and 15.21 (stated and proved in Section [5]) that Z„ is transient if and only if 2p' > cx^, or 
equivalently 1 — (l/rf) > (l/rf), that is, d > 2. □ 
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3.3 The process viewed as a new random polymer model 

In this section we briefly summarize motivation of self-interacting random walks arising 
from polymer physics, and give an interpretation of our model described by (Al) in that 
context. Much more background is provided by, for instance, [28l Section 2.2], [371 Chapter 
7], [13 Chapter 7], and, for the underlying physics, [36]. Recent accounts of some of the 
relevant probability theory are given in [T^fTB]. 

The sites visited by the walk X„ represent the monomers that make up a long polymer 
molecule in solution in M*^ (of course, physically d G {2,3} are most interesting). The line 
segments between successive sites X„ and Xn+i represent the chemical bonds holding the 
molecule together; in this regard our condition of uniformly bounded increments in (Al) is 
natural. We assume that the polymer solution is dilute, so that interaction between different 
polymer molecules can be neglected. 

In real polymers, a phase transition is observed between polymers in poor solvents (or at 
low temperature) and good solvents (or high temperature) [36l Chapter 7]. In poor solvents, 
a polymer molecule collapses as the attraction between monomers overcomes the excluded 
volume effect caused by the fact that no two monomers can occupy the same physical space. 
In good solvents, a polymer molecule exists in an extended phase where the excluded volume 
effect dominates. 

It is the extended phase that is believed to lie in the same universality class as SAW. 
Heuristic arguments dating back to P.J. Flory (see e.g. [281 Section 2.2]) suggest that in 
this phase ||^ri|| should exist on 'macroscopic scale' of order for an exponent u = i'{d) G 
[1/2, 1], with 1/ < 1 for c? > 1 and i/ > 1/2 for < 3. So for d G {2,3}, the polymer is 
expected to be super- diffusive but sub-ballistic. According to Theorem I2.4( i). our model 
defined by (Al) has macroscopic scale exponent max{l/2, 1/(1 + /3)} when p > 0; for /3 < 1 
this regime therefore corresponds to polymers in the extended phase, where the excluded 
volume effect, summarized by repulsion from the centre of mass, dominates. For instance, 
since z/(2) = 3/4, in ci = 2 the 'physical' choice of our model has /3 = 1/3 and p > 0; it is 
not clear to what extent that case of our model replicates the behaviour of SAW. 

On the other hand, the collapsed phase corresponds to taking p < in (Al), where the 
polymer's self-attraction, summarized through its centre of mass, is dominant. See Theorem 
I2.4( iii) and (iv). Between the poor and good solvent phases, there is a transitional phase 
at the so-called 6-point at which the temperature achieves a specific (critical) value T = 6. 
Here the excluded volume effect and self-attraction are in balance, and the molecule behaves 
rather like a simple random walk path. Compare Theorem I2.4( ii). 



4 Properties of the self-interacting random walk 

Under the assumption (Al), we are going to study the process X„ — Gn and in particular 
determine whether it is transient or recurrent. It suffices to study — In this section 
we analyse the basic properties of the latter process; subsequently we will apply our general 
results of Section [5] on processes that satisfy, roughly speaking, (II. 4p . 

We introduce some convenient notation that we use throughout. For n G N set 

-y Y r' A Y Y 

n • -^n '-^nj '-^n • ^n- 
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We start with some elementary relations amongst X„, G„, and Y^, following from (11 .ip . 

Lemma 4.1. Suppose that {Xn)nm is a stochastic process on W^, and (G'n)neN is its centre- 
of-mass process as defined by ( f i. il) . For n we have 

n 1 

Gn+i = — — rGn H —Xn+i, and (4.1) 

n + I n + 1 

Ti 

y„+i = ^— (F„ + AO. (4.2) 

n + I 

Moreover Gi = Xi and for n G {2, 3, . . .}, 

n 

G^ = X, + Y,-—Y,. (4.3) 
Proof. Equation (14. ip is immediate from (II. ip . Then from (14. ip we have that for n G N, 

= — Cn+l = — (^n+1 " Gn) , (4-4) 

+ 1 

from which (14. 2 p follows since — Gn = Yn + A„. For (14. 3p . we have from (14. ip again 

that for n G N, 

1 1 

Gn+l — Gn = — [Xn+l — Gn) = —Yn+1, 

n + 1 n 
where the final equality is obtained from (14. 4p . Thus for n > 2, 

n— 1 n— 1 



Gn-Gi - ^(Gj+i - Gj) - ^ -^j+i, 



from which (14. 3 P follows. □ 

The main result of this section concerns the increments of the process ||^n|| under as- 
sumption (Al) and also possibly (A2). Part (i) of Proposition 14.11 gives basic regularity 
properties, including boundedness of jumps. Part (ii) gives an expression for the mean drift 
when /3 G [0, 1). Part (iii) deals with the case /3 > 1 when (A2) also holds. 

Proposition 4.1. Suppose that (Al) holds. 

(i) There exists G G (0, oo) for which, for any n G N, 

P„[|||F„+i|| - IIKIII >C] = 0, a.s.. (4.5) 

In addition 

limsup ||F„|| = oo, a.s.. (4.6) 

(a) If /3 E [0,1) then, a.s., 

En[\\Yn+l\\ - \\Yn\\] = p\\Yn\\-^ " + 0(||i;,||-^(log r„||)-^). (4.7) 
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(in) Suppose also that (A2) holds and /3 > 1. Then, a.s., 



\yn\ 



n + I 

+ o(||y„iri(iog||r„||)-i) (4.8) 

E„[(||F„+i|| - \\Yr,\\f] = a^ + O(n-iKll) + o((log r„||)"^). (4.9) 

We prove Proposition 14.11 via a series of lemmas. The first gives information on the 
increments of the process given by the distance of a general stochastic process to its centre- 
of-mass. In particular, it shows that inherits boundedness of jumps from X„, and gives 
an expression for the increments of in terms of A„, the increments of Xn- 

Lemma 4.2. Suppose that [Xn)nm is a stochastic process on , and {Gn)nm is its centre- 
of-mass process as defined by ( fi.ij) . Suppose that Xi G M'^ is fixed and that ^2. ij) holds for 
some B G (0, oo). There exists C G (0, oo) for which, for all n G N, ( [^.5| ) holds. Moreover, 
a.s., 

\\y.»\\ - IIKII - + - ^1^) . 0(||K„||-) - JM. ,4,0) 

Proof. We work with the process (||y„||)„gN. From (12. ip and the triangle inequality, we 
have the simple bound \\Xn\\ < ||^i|| + B{n — 1) a.s., for all n G N. Applying the triangle 
inequality in (II. ip then yields the equally simple bound 



1 . R 

Gn\\<-Y^{\\X,\\+B{^-l))<\\X,\\ + ^. 



n 
1=1 

Combining these two inequalities together with the fact that \\Yn\\ < \\Xn\\ + HGnll, it follows 
that ||1^„|| < 2||Xi|| + {3Bn/2) a.s., for all tt, G N. Then from the triangle inequality and 
(14. 2 p we have that 

I ll^n+lll ~ ll^nll I < ~ ^nll < — ll^rJI + 11^ ' 



n In 

a.s., by (12. ip . and this lattermost quantity is uniformly bounded. Thus we have (14. 5p . 
For the final statement of the lemma, note that, from (14. 2p . 



= ^ + II A„f + 2F„ ■ A„)^^^ . (4.11 

Now writing y = K„ for convenience, we obtain from (14. lip that 

n / , ||A„f + 2yA ^"'^ 



,1/2 



■^+1 ~ M^iii 11^ II , 1 I - ■ II I 

n + 1 y ||y I 

Using Taylor's formula for (1 + xY^"^ with Lagrange remainder in ( I4.12p implies that 



(4.12) 



n + 1 V 2||yP 8||yf '""^ " 'J n+l' 



using (12. ip for the error bound. Simplifying and again using (12. ip . this becomes 



n + lV2||yP ||yP 2||y||4 " 'J n + 1 

Then equation (14.101) follows. □ 

Now we turn to the model defined by (Al), starting with the drift of ||l^n||- For a, & G M, 
we use the standard notation a Ab := min{a, b}. 

Lemma 4.3. Suppose that (Al) holds. Then the drift of satisfies, a.s., 

E.[r.+iii - = ^ {p\\Y^\\-^ + Qnim-') - ^ 

+ omr^'^^\\og\\Y4r% (4.13) 

where 0.„ is the J^n-'^^O'Surahle random variable given by 

e„ = l||K„|rX[rnf ||A„f - (F„ • K)\ (4.14) 

Moreover, there exists C < oo such that 6„ G [0, C] a.s., and if /3 E [0, 1), ( |^. 7p holds. 
Proof. Taking expectations in (I4.10p . using the fact that 

||r„ir%[r„ ■ A„] = p\\Yj~^ + 0(||F„|r^(log 
by (12. 2p . we obtain 

E.[||i;+i|| - =^ (^p\\Yn\\-' + ^^E„[||r„f ||A„f - (F„ ■ A„)^]) 

+ 0(r.||-(^-)(log||F.||)-)-JM. 

By the fact that |F„ ■ A„| < ||F„||||A„|| and the jumps bound (12.11) we have that 

< E„[||r„f II A„f - (F„ ■ A„)2] < C\\YJ', a.s., 

for some C e (0, oo). Thus defining 0„ by (I4.14p we obtain (I4.13P and the fact that 9„ G 
[0, C] a.s.. Then (gTD follows when /3 G [0, 1). □ 

The next result shows how the ellipticity condition (12. Sp leads to (14. 6p . 

Lemma 4.4. Suppose that (Al) holds. Then limsup„_^oo = oo a.s.. 

Proof. We have from (14. lip that 

2 

rilA l|24-9V . A _ - 

(n + 1) 



r.+if - \\Ynr = (II A„f + 2F„ . A„) - ^^\\YJ'. (4.15) 
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Fix PEN, and define := nZnlJ^^h^i ■ > Eq} and F„,2 := {\\Ynp\\ < '-^}. Fix also 
Up E N with EoUp > 16C, where C is as in f l4.5p . and consider n > Up only. By (12 .Sp we have 
that P„[F„^i] > Eq a.s., and hence Levy's extension of the second Borel-Cantelli lemma (see 
e.g. [ini Theorem 5.3.2]) implies that P[F„,i i.o.] = 1. 

Now, observe from (14. 5 p that < + C, a.s., which implies on F„^2 that < 

^E^np for all i G {np, . . .np+ {p — 1)}. Then, on nFn^2, "we obtain from (I4.15P that, a.s., 

m^iW - mr > --Mf + l{ei+ 2Eom\) > \eom\\ + \eI > ^-ei 

for any i with np < i < np + {p — 1) and any n > np. Hence on F„ i fl -F„,2; a.s., 

np+(p— 1) 

mn+Dpf = wYnpf + Yl m+iW -mr)> pel/ 

i=np 

Thus, up to sets of probability zero, {(-Fn,i H -F„^2) i-o.} C {limsup„^oc ||y„|| > P^^'^eo/2}. 
Moreover, by definition of F„^2, {-^n2 i-O-} — {lii^sup,„^oo = oo}. Since {Fn,i i.o.} C 
{{Fn,! n Fn,2) i-o.} U {F„^_2 i-o}, it follows that {Fn,i i.o.} C {limsup„^^ ||F„|| > p^/^Eo/2}. 
Since p was arbitrary, the result follows from the fact that P[-Fn,i i-o.] = 1, as shown in the 
first part of this proof. □ 

When (Al) holds with /3 > 1, we need more regularity to obtain a well-behaved version 
of (I4.13p . Thus we impose (A2) and use the following result, which in addition gives an 
expression for the second moment of the increment — ||5^n||- 

Lemma 4.5. Suppose that (Al) and (A2) hold. Then 0„ as defined by (JjJ^ satisfies 

Qn = lid - l)a^ + o((log IIKII)-^), a.s.. (4.16) 

Moreover, ([^.g|) holds. 



Proof. First we prove (I4.16p . We have that 

d 

E4||A„f] = ^E4(A«)2] = da' + o{{log\\Y4r'), 

i=l 

by (12. 5p . Also if y„ = (t/i, . . . , yd) G W^, with the convention that an empty sum is 0, 

d d i 

E„[(y„ ■ A„)2] = 5^y,2E„[(A«)^] + 2^^ 5^y.y,E„[A»Ai^-)] 

i=l i=2 j=l 

= \\Y4' [a' + oii\og\\Yj)-')] , (4.17) 

by and (ESD- Then f lTO]) follows from f imp . 

Next we prove (14. 9p . Squaring both sides of (I4.10p and taking expectations we obtain 

E„[(||F„+i|| - \\Yjy] = ||F„rX[(l^n ■ A„)2] + 0{n~'\\Y4) + 0{\\YJ"'). 

Now using (HTTP yields (^M). □ 

Proof of Proposition \4-l\ We collect results from Lemmas 14. 2[ 14. 3[ 14. 4[ and 14.51 □ 
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5 Recurrence classification for processes satisfying 
equation (11.41) 



5.1 Introduction 

In this section we state general results for processes with drift of the form (11. 2p . We will 
later apply these results to the process — Gn\\ satisfying (Al) (and maybe also (A2)), 
but for this section we work in some generality. 

Let {Zn)nm be a stochastic process taking values in an unbounded subset S of [0, oo), 
adapted to a filtration (J-'n)nGN- Recall the definition of fikin^x) from (13. ip . so that 
Kn[{Zn+i — ZnY] = fik{n; Zn) a.s.. As discussed in Section ISTTj the case where fi2{n;x) 
is 0(1) and fii{n; x) — as x — )■ oo arises often in applications; the case where /ii(n; x) — )■ 
uniformly in n is sometimes known as Lamperti's problem after Lamperti's work PTH2B] . 
Roughly speaking, the Lamperti problem has /ii(n;a;) ~ /3 > 0, p G M, ignoring 

higher-order terms. Results of Lamperti [2T1|23] imply that the case /3 = 1 is critical from 
the point of view of the recurrence classification. The supercritical case, when /3 G [0,1), 
p > 0, has also been studied (see [31] and references therein). 

In this section we study the analogous problem for which px ^ — (x/n). In 

keeping with the applications of the present paper, and to ease technical difficulties, we 
adopt some stronger regularity assumptions than imposed in [2T1|23] or [21]. Nevertheless, 
this version of the problem is more difficult than the classical case (without the extra —x/n 
term in the drift). Thus although the ideas in this section are related to those in [21] 123] 
and [31] , we have to proceed somewhat differently. In particular, to obtain our /3 < 1 law of 
large numbers in this setting (an analogue of [HT| Theorem 2.3] for the standard Lamperti 
case), we use a 'stochastic approximation' result (Lemma l5.ip . the proof of which uses ideas 
somewhat similar to those in [30|[3T]. 

We impose some regularity conditions on (Z„)„gN. Suppose that there exists C G (0, oo) 
such that for all n G N, 

P„[|Z„+i - Z„| > C] = 0, a.s.. (5.1) 

We also assume that 

limsupZ„ = oo, a.s., (5.2) 

n— >oo 

without which the question of whether {Zn)nm is recurrent or transient (in the sense of 
Definition 12. ip is trivial. Note that (15. 2p is implied by a suitable 'irreducibility' assumption, 
such as, for all y > 0, inf„gN Pn[^m — Zn > y for some m > n] > 0, a.s.. In our case, as in the 
standard Lamperti problem, we will see a distinction between the 'critical' case where P = 1 
and the 'supercritical' case where (3 G [0, 1). Thus we deal with these two cases separately 
in the remainder of this section. 

5.2 The critical case: (3 = 1 

For X > and n G N define 

r(n; x) := + (log(l + x))"-^. (5.3) 
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For p > we write log^x for (logx)^. We impose the further assumptions that there exist 
p' G M and G (0, oo) such that 

fii(n; x) = px~^ h o(x~^r(n; x)), (5.4) 

n 

fi2{n; x) = s"^ + o{r{n] x)). (5.5) 

Theorem 5.1. Suppose that the process {Zn)neN satisfies ( (5. h5.2\) . ([5.^[ ) and h5. 5]) for 

some p' G M and G (0, oo). T/ien 2/2p' < s^, zs recurrent. 

Proof. Let := log log Z„,. Write Dn := ^n+i — Zn- First note that Taylor's formula 
implies that for x, h with a; — )■ oo and = o{x/ logx), 



loglog(x + /i) = log log X + — — + 0{h^x~^ [log x)~^] 

X log X 2x^ log X 



Setting X = Z„ and h = Dn and then taking expectations, we obtain 

IF \W W 1 - /^i^^'^") (log^« + l)/i2(n;Z„) 3 

- vy„j - — — — 2"— h O-l^Z^ j, 

Z.„logZ„ SZ^log z„ 

using (15. ip for the error term. By (15. 4p and (15. 5p this last expression is 

2p' - s2 s2 1 



2Z2 1ogZ„ 2Z^\og^Zn n\ogZ„ 



o(Z-2(logZ„)-V(n;Z„)) <0, 



for all n and Z„ large enough, provided 2p' — < 0, by (15. 3p . Thus there exist non-random 
constants Wq G (0, 00) and rii G N for which, for all n > ni, on {Wn > Wq}, 

En[Wn+l - Wn] < 0, a.S.. 

By Doob's decomposition, we may write Wn = Mn + An, n > ni, where Wn-^ = Mn^^, 
{Mn)n>ni IS a martingale, and the previsible sequence {An)n>ni is defined by 

n— 1 n— 1 n— 1 

An= ^m[Wm.+l ' W„,] < ^ E„,[Wm+l - Wm]l{Wm < Wq} < C H^^rn < Wo}, 

m=n\ m=n\ m=n\ 

since the uniform jumps bound (15. ip for Zn implies a uniform jumps bound for Wn, n > ni. 
Hence Wn — oo implies that lim sup^^g^ y4„ < oo so Mn — )■ oo also. However, (M„)„>„^ 
is a martingale with uniformly bounded increments (by (15. ip ) so P[M„ — )■ oo] = (see 
e.g. [ini Theorem 5.3.1, p. 204]). Hence P[liminf„^oo W^n < oo] = 1. □ 

Theorem 5.2. Suppose that the process {Zn)ne'N satisfies ( 15. ( 15. ( (5.^[ j and ( 15. 5\) for 

some p' G M and G (0, oo). Then if 2p' > s^, Z„ zs transient. 

Proof. This time set 

1 9 



log Zn log n 
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(log(n + - (logn)-i = fA^,„ .^ = -- T-^ + 0{n^'). (5.7) 



Again write Dn := — Z„. We want to compute 

E„[iy„+i - Wn] = E„ [(log(Z„ + - (logZ„)-i] 

+9 [(log(n + 1))"' - (log ny^] . (5.6) 

Observe that, for the final term on the right-hand side of (15. 6p . 

l og(l - jn + l)-') ^ 1 

lognlog(?7, + 1) nlog^n 

Also for the expectation on the right-hand side of (15. 6p we have that 

En [{\0g{Zn + DnT' - {hg Z^)-'] 

Taylor's formula imphes that for a = 0(1) and y = o(l), 

(1 + a log(l + y))-' = l-ay+ '^^-^y^ + Oiy'). 

Applying this formula with a = l/logZ„ and y = Dn/Zn we obtain, 

E„ [(log(Z„ + A-0)"'-(logZ„)-^] 
_ /ii(n;Z,,) ^ /i2(n;Z„) ^ fi2{n; Z^) , ^fr^^s^ 



n 1 1 



ZnXoiZn IZlXoiZn ZlXoiZn 
by (15. ip . Now using (15. 4p and (15. 5p we obtain, 
E„[(log(Z„ + D„))-'-(logZ„)-i] 

= ^^Sl^ f-*^"' - + ""-'"^ + 0((logZ„)-)) + (5.8) 

Suppose that 2p' - > 2e > 0. Then by Q, dESD, dEZD and ([EH]) we have that there 
exist non-random constants rag G N and Xq G (1, oo) such that for all n > Uq, on {Zn > Xq}, 
a.s., 

- 1^„] < - .^,'2^ - -rV + V^^- (5-9) 
2Z^log Z„ nlog n 2nlog Z„ 

We have that the right-hand side of (15. 9p is bounded above by 

1 f -e 3 \ 1 f -e 3e 



log^ Z„ V2^^ - log^ Z„ \2Zl %zi 

provided n > 4Z^£~^, and this last upper bound is negative for Z„ > xq. On the other hand, 
if n < 4Z^£~^ the right-hand side of (15. 9 p is bounded above by 

3/2 8 \ 1 / 7 „ , 

' * < - -^^ < 0, 



n \ log^ Zn log^ n / \ log^ n log^ 
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for Zn > Xq and n > uq. Thus in either case we have concluded that for all n > no, on 

{Zn > Xo}, 

E„[l^„+i - < 0, a.s.. (5.10) 
Now fix > 1 and Xi > Xq. Define the stopping times 

ax '■= minjn > maxjno, x}^'^} : Z„ > x^^}; Tk '■= min{n > ctr '■ Zn < Xi}. 

By (I5.2p we have that F[aK < oo] = 1. From flS.lOp and the definition of tk we have that 
{WnATjf)n>aK is & nou-uegative supermartingale, and hence it converges almost surely to 
a [0, oo)-valued random variable W := W^^\ In particular, since ax < oo a.s., we have 
lim„^oo W^nATx = W, a.s.. Moreover 

E[W] > E[Wl^,,^^y] = E[Wr,l^r,^^}] > ^^^^<^\ (5.11) 
since Z^^^ < Xi. On the other hand, since {WnATK)n>aK is a supermartingale, 

using the facts that Zcr^^ > x\^ and ax > x^'^'^ ■ Combining (15. lip and (I5.12p we see that 

K <oo\ ^ 3 



log xi AK log xi 

On {(Tx < oo} n {tk = oo}, we have that lim inf „_5.oo > Xi, so the preceding argument 
shows that P[liminf„^oo ^ Xi] > 1 — ^ for any K and any Xi > Xq. It follows that 
' J„ ^ oo] = 1. □ 



5.3 The supercritical case: f3 G [0, 1) 

Once again we will assume that (15. ip and (I5.2p hold. We will also assume that there exist 
/3 e [0, 1) and p G M \ {0} such that 

X 

fxi{n; x) = px~^ h o{x~^) + o{xn~^). (5.13) 

n 

Theorem 5.3. Consider the process (Z„).„gN satisfying ( 15. ( (5.^) . and ( 15. where f3 G 
[0, 1). Then is transient if p > and recurrent if p < 0. 

Proof. First suppose that p > 0. By (15. ip we can choose p' G (0, oo) so that 2p' > > 
En[{Zn+i - Zn)% a.s., and, by (|5.13p, 

E„[Z„+i - Zn] > (p' + o(l))Z-i - ^ + o(Z-V(n; Z„)), a.s.. 

It is this inequality, rather than the equality (15. 4p . that is needed in the proof of Theorem 
15.21 Hence following that proof implies transience. Similarly, if p < we have, for any 
p' G (— oo, 0), a.s., 

E„[Z„,+i - Zn] < {p' + o{l))Z-' - ^ + o(Z-V(n; Z„)). 
Using this inequality in the proof of Theorem 15.11 implies recurrence. □ 
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The rest of this section works towards a proof of the following law of large numbers. 

Theorem 5.4. Consider the process {Zn)n&n satisfying Ii5. / IJ.^j) . and Ii5.13\) . where (3 G 
[0, 1) and p > 0. Then, with i{p, /3) as defined at l{2.8\) . as n ^ oo, 

>iip,l3). (5.14) 



The proof uses the following lemma, which is of some independent interest, and falls 
loosely into a family of "stochastic approximation" results; see e.g. [3ll Section 2.4]. 

Lemma 5.1. Suppose that {Vn)neN is a non-negative process adapted to the filtration 
(J-'„)„,gN- Suppose that there exists r > such that the following hold. 

(a) There exists a non-negative sequence {■yn)ne'N adapted to {J^n)nm with J^nen^n < oo 
a.s. such that for any b > and all n & N we have that, a.s., 

E„ [(K+i - K)'] < C{bhn on {K < b}, 

where C{b) is a constant depending only on b. 

(h) There exists e > 0, and for any 6 G (0,r) there is a sequence of events An = An{S), 
77, G such that An G J^n, ^[An i-o.] = 0, and a.s. for all n G N, 



En[K+i] < Vn on {Vn>r + 6}n Al, and E„[K+i] > K on {Vn < r - 5} H A^, 

and also A^^ C {K+i > (1 - 

Then a.s. lim„_^oo = Voo exists in [0,oo). //, additionally, 

(c) there exists a non-negative sequence {f)n)nm adapted to (J-'n)n.eN with Ylmm'^^ ~ 

a.s. such that for any a,b with < a < b and r ^ [a,b], for all n large enough, on 
{Vn G [a,b]], a.s., 

lEn[K+i - Vn] < -C{a,b)% ifr < a, 

En[Vn+l - Vn] > ^(a, b)% if T > b, 

where C{a, b) > is a constant depending only on a and b, 
then Voo e {0,r}. 

Proof. We first show that under conditions (a) and (b) of the lemma, Vn converges a.s. to 
some finite limit Vnr,- We claim that 



P 



{liminf K < r} U {3 lim Vn>r} = 1. (5.15) 



Indeed, suppose that {liminf„_>.oo Vn < r} does not hold, so that liminf„^.oo Vn > r + 6 for 
some 6 > 0. For M G N let 

r^*'') := inf{?T, > M : 14 < + ^ or An{6) occurs}. 
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and define Vn^^ := V^^^^iM). Then, for eacli M, by (b), {Vn^^)n>M, is a non-negative 
supermartingale and fience converges a.s.. On tlie otlier fiand, from (b) and our assumption 
tfiat liminf„_!.oo Vn > r + 6 it follows that a.s. r*-^^-* = oo for some M; in this case Ki^^^ = Vn 
for all n > M and hence Vn must also converge a.s., and the limit must be greater than r. 
This establishes flS.lSp . 

By an analogous argument with a bounded submartingale we also establish 



P 



{limsup Vn > r} U {3 lim Vn < r} 



1. (5.16) 



Given f lS.lSp and fl5.16p . to show that lim„_^oo exists a.s. it suffices to demonstrate this 
convergence on the set 

E := {limsup Vn> r} (1 {liminf Vn < r}. 

71— >CXD n— >oo 

Let us prove that on E in fact limsup^^o^ = For 6 > define 

Es := E n {lim sup Vn > y + 6} where y = r + 26. 

We will show that P[Es] = for any 6 > 0, which yields the desired conclusion. 
Fix some such that V^^^ > y + 6. Iteratively for i = 0, 1, 2, . . . define 



min{n > Ui : Vn < y - S}, 
mm{n > : Vn > y - S}, 
min{n > Ti : Vn > y + S}. 



On E we have Vn < r + 6 infinitely often, so that Vn < y — 6 infinitely often. Thus our 
definitions imply that Xj, /tj, and Ui are finite for all i on Eg. Next, setting Bn '■= {Vn-i < 
y — 6, Vn > y}, we have by Levy's extension of the second Borel-Cantelli lemma (see 
e.g. dQl Theorem 5.3.2]) 

{{K, >y, Ki< oo} i.o.} C {Bn i.o.} = I ^P„[5„+i] = oo 

IneN 

up to events of probability 0. On the other hand, 

Fn[Bn+l] = Pn[K+l > y]l{Vn < y - 6} 

<^n[\Vn+l-Vn\>6]l{Vn<y-6} 

< S-^En[{Vn+l - VnYMVn < V - 5} , (5.17) 

by Chebyshev's inequality, so that by f l5.17p and (a), 

J2^n[Bn+i] < J25~'Ciy - 5)7n < OO, a.s. (5.18) 

neN neN 

Thus on Es, by f l5.18p and the Borel-Cantelli lemma, {V^- > y} occurs only finitely often 
a.s., so there is some Ni & N for which V^^ E {y — 6, y] for all i > Ni. Now let 

r]i := min{n > Hi : Vn < y - S or Vn > y + S} < z/^+i. 
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On all the rji are also finite (since the vi are finite). For n G N define 

J 1, ii Ki <n < Tji for some i and occurs; 
[ 0, otherwise, 

n.-l 

E„[(V;+i - Vn)In] and = ^[(K+i - K)/. - ^.], 

with an empty sum understood as zero so that M„ = for n < kq. Then {Mn)nm is a 
zero-mean martingale adapted to (J>i)„gN, and it is not hard to see that 

E^M^+i - M^] = E„[(M„+i - M„)2] < E„[(K+i - K)'/n]. 

Moreover, since for Hi < n < rji we have y — 5<Ki<y + (5, from (a) it follows that 

E4M2^,-M2]<C(y + 5)7n. 

This implies that the increasing process associated with M„ is bounded by a constant times 
J2neN'yn and hence is a.s. finite by (a). Consequently, by [101 Theorem 5.4.9] the martin- 
gale Mn converges a.s. to some finite limit; in particular, there is some N2 & N for which 
sup„ „j>jV2 \Mn — Mm I < S a.s.. Then for all i > Ni such that > N2 we have 

since, by (b), Dn < for n e [ni^rji), n > N2, and V^. < y for all i > A''i. Consequently, the 
process Vn eventually exits the interval {y — 6,y + 6) only on the left (and it cannot jump 
over it, as we showed above), contradicting Es- So F[Es] = 0. 

A similar argument shows that on E not only lim sup^^^o Vn = r but also lim inf „_>.oo Vn = 
r; we sketch the changes needed to adapt the previous argument to this case. Analogously 
to Es above, we define E'^ := E n {liminf < y — 6} where y = r — 26 and 6 e (0,r/3). 
Also fix some z/q such that V^,^ < y — 6, and iteratively set 

T- := mm{n > i'[:Vn>y + 5}, 
K- := min{n > t[ -.Vn <y + 5}, 
i^'i+i := min{n > t[ -.Vn <y - 5}. 

This time let B'^ := {K-i > y+5, Vn < y}. Now by definition of A^, {K > (l-e)^V}nA^ C 
{Vn+i >r}C (fi:,+i)^ so that 

¥n[BUl]<^n[BUMAl) + HAn) 

< P„[5; < (1 - ey'r} + liAn). 

A similar argument as that for fl5.17p and fIS.lSp . using Chebyshev's inequality and (a), with 
C{y — S) in flS.lSp now being replaced by C((l — e)~^r), shows that, a.s., < 
(1 — e)~^r} is summable, while 1(A„) is a.s. summable by assumption in (b). As before. 



In = 
Dn = 
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it follows that {Vr' < y} a.s. occurs only finitely often. Then a similar argument to the 
previous case, with the martingale M„, shows that Pf-E^] = as well. 

Consequently , on E, lim„^oo Vn a-S- exists and equals r in this case. Thus the first claim 
of the lemma follows, and Voo = lim„^oo Vn a.s. exists in [0, oo). 

To prove the second claim of the lemma, under the additional condition (c), we show 
that F[Voo G (0, r) U (r, oo)] = 0. To this end, suppose that Vn ^ y > r (the case y G (0, r) 
can be handled similarly). Choose a small 6 > such that y — 6 > r. Then a.s. there 
exists an such that \Vn — y\ < 6 for all n > N^. Now define D'^ = Kn[{Vn+i — Vn)] and 



the martingale = ^"Z^ [(K+i — K) ~ D'^]- Then by (c) we have that for all n > N^, 
D'^ = E„[(V^+i — Vn)] < —C{y — 6,y + S)%. By a similar argument to that for M„ above, 
must converge a.s.. However this leads to a contradiction with the inequality 

n— 1 n— 1 

[Vn - Vm,] - K - ^^3] =J2^'s< -C{y -S,y + 6)J2 7s, 

S=N3, S=N3 

since, a.s., as n — )■ 00 the right-hand side converges to —00 while the left-hand side converges 
to a finite limit. □ 

Now we can give the proof of Theorem 15. 4[ 

Proof of Theorem \5.4\ It suffices to prove that 

n 2 + (3 



lim 



a.s.. 



Set Vn = {n- 1)/Z^+^ and K = n/Z^+^ = ^Vn. Writing D„ := Zn+i - Z„, we have 



(5.19) 



V 



n+l 



Vn = Vn 



, Dn 
1 + — 

z„ 



n 



Vn 



:i + l^)Dn 

Zn 



using Taylor's formula and ( 15. ip for the error term. Hence 



V 



n+l 



<' n 

n 



;i + P)nDn 



0{nZ--- 



Taking conditional expectations in f l5.20p we obtain, on {Zn — ?■ 00}, a.s. 



n 



Vn 



[l + /3)n/xi(n; Zn) 



+ 0(nZ„ 



^[2 + /3 + o(l)-((l + /3)p + o(l))K], 



n 



0{Zn 



(5.20) 



(5.21) 



using (I5.13p . and then using the fact that Z„ — ?■ 00 to simplify the error terms. Similarly, 
squaring both sides of (15.201) and taking expectations, on {Zn — ?• 00}, a.s.. 



E„[(K 



n+l 



Vn 



V 
_ 



2(l + /3)n/ii(n;Z„) ^^ ^ ^^^^^ ^ (1 + /3) V/i2(n; Z„) ^ ^^^^^ 
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using (15. ip to obtain the error terms. Then from (15. 5 P and (I5.13P we obtain 



ri+1 



2 



n 



3 + 213 + o(l) - (2p(l + (3) + o(l)) Vn + 



(c + o(l))r2^ 



(5.22) 



for some c G (0, oo) (depending on and (3) as Z„ — oo and n — )■ cxd. For a fixed b > 
and y4 < oo, there exists a (non-random) no for which {Vn < b} imphes that {Z„ > A} for 
all n > uq. In particular, from (I5.22p we have that for some (non-random) C{b) < oo, on 
{Vn < b}, for any n G N, a.s.. 



E4(Kh 



K)'] < ^ 



0(1) + (c + o(l))n2(K/n)W <C(6)n"W 



Since (3 < 1, XlngN '^"^''^^'''^^ < oo so that the conditions of part (a) of Lemma [5Jl are 
satisfied with the present choice of Vn and 7„ = n~'^^^^~^l^\ Let An := {.^n < By Theorem 
15. 3[ Z„ — oo a.s., so that An occurs only finitely often for any A G (0, oo). Taking r = -j^^i^, 
the conditions on E„[Ki+i] in part (b) of Lemma 15.11 are shown to hold for any 5 G (0,r), 
taking A = A{6) sufficiently large, by (I5.2ip . Indeed, from (I5.2ip . on {Vn > r + 6} for some 
5G(0,r), 

E^K+i - Vn] < -5(1 + /3)p(l + o{l))n~'Vn, 

which is negative on A'^ for our choice of A = A{6). A similar argument holds for the other 
condition on E„[Ki+i] in Lemma 15.1( b). The final condition in (b), that A'j^ implies that 
Vn+i > (1 — e)Vn for some e G (0, 1), follows from (I5.20p and the fact that Z)„ is uniformly 
bounded (by (15.10 ). taking A and n sufficiently large in our choice of An- 

The conditions in part (c) of Lemma [5.11 follow from (15.210 again, with 7„ = n~^, noting 
that the o(l) terms in (I5.2ip are uniformly small on {Vn < b} for any n > uq (for some 
non-random no G N). 

Hence we conclude from Lemma [5.11 that Vn — ?■ V^o a.s. where Voo G {0,r}. To complete 
the proof of the theorem we must show that — )■ 0] = 0. This, however, follows from 
the fact that limsup„_^(^(n~^/(^"'"'^)Z„) < oo a.s. due to [311 Theorem 2.3], noting the remark 
following that theorem. □ 



6 Proofs of main theorems on self-interacting walks 

6.1 Recurrence classification: Proofs of Theorems 12.11 and 12.31 

We apply the results of Section [5] to Z„ = = — 

Proof of Theorem \2.1[ Suppose that (Al) and (A2) hold, and that (3 > 1. First note that 
with Zn = \\Yn\\, (iSD and (gj]) imply ([5J]) and (Q- Now from (gj]) we obtain, with 
r(n;x) defined by (15.30 . 

E„[Z„+i - Zn] = [ pl{/3=i} + ^{d - l)o-^ ]— - + o{Z~^r{n] Zn)), a.s. 
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Similarly, we have from (14. 9 p that 



E„[(Z„+i - Z^f] = a^ + 0{Z^n-^) + o((log Z„)-i). 

First suppose that /3 = 1. Thus ([EID and ([53]) hold with p' = p + (rf - l)(crV2) and 
= cr^. It follows from Theorems 15. II and 15.21 that Z„ is transient if and only if 2p' > s^, or 

equivalently 2p > cr^(2 — rf), i.e., p > po. This proves part (i) of the theorem. 

Finally suppose that /3 > 1. This time (15.41) and (15. 5p hold with p' = {d - l)(o-^/2) and 
= 0"^. It follows from Theorems 15. II and 15.21 that Z„ is transient if and only if 2p' > s^, or 

equivalently cr^(2 — d) < 0, i.e., d > 2. This proves part (ii). □ 

Proof of Theore'm \2.3[ Suppose that d = 1. If 1^ is transient, then by (14. 5 p we have that 
with probability 1 either: (i) y„ — )■ +oo; or (ii) F„ — )■ — oo. In case (i), there exists G [2, oo) 
for which Yn > 1 for all n > N, so (14. 3 P with (14. 5 P implies that for n > N, 

n ^ 

Gn>Xi- CN + V > oo, a.s., 

as n — 7- oo; a similar argument applies in case (ii). Since Xn = Yn + Gn, and Yn, Gn are 
transient with the same sign, it follows that X„ is transient too. □ 

6.2 Limiting directions: Proof of Theorem 12.21 

The key first step in the proof of Theorem 12.21 is the following application of the law of large 
numbers. Theorem 15.41 

Lemma 6.1. Suppose that (Al) holds with d G N, /3 G [0, 1), and p > 0. As n oo, 

n-''^'^P^\Xn-Gn\\^l{p,P). 

Proof. We take Z„ = = \\Xn — Gn\\ and apply Theorem 15.41 The conditions of the 

latter are verified since (14. 5p . (14. 6p . and (14. 7p imply (15. ip . (15. 2p . and (I5.13P respectively. □ 

The second step in the proof of Theorem 12.21 is to show that the process Yn = Xn — Gn 
has a limiting direction. Together with Lemma [6.11 and the simple but useful relation (14. 3p . 
we will then be able to deduce the asymptotic behaviour of X„ and Gn- 

We use the notation Yn := with the convention that := 0. Then {Yn)nm is 

an (J^„)-adapted process, and using the vector-valued version of Doob's decomposition we 
may write 

Yn = An + Mn, (6.1) 

where Mi = Yi, (M„)„gN is an (J^„)-adapted d- dimensional martingale and {An)neN is the 
previsible sequence defined hj Ai = and An = J2^=i'^rn[Ym+i — Ym] for n > 2. 

Lemma 6.2. Suppose that (Al) holds with d E N, /3 E [0,1), and p > 0. Let the Doob 
decomposition of Yn be as given at Ii6. There exists a d- dimensional random vector A^ 
such that An — )■ A^^ a.s., as n ^ oo. 
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Proof. We have from (14. 2 p that, with A„ := — X„ as usual, 



Yn + A„ 
\Yn + AJ 



IF + A I 



Yn^n 



\Yn + K\ 



\Y. 



\Yn + AJ 



=: Ti - Y^T,. 

We deal with the expectations Ti and T2 separately. First, 

||y„, + AJ|-||rj|)A„ 



Ti = ||K„|rX[A„] -E, 



\Y II iiy + A I 



The numerator in the last expectation is bounded in absolute value by ||A„||^, by the 
triangle inequality. Then using the fact that ||A„|| is uniformly bounded, and that 
||F„|| ~ £(p,/3)n^/(^+^) by Lemma ETH it follows that 



Ti = ||r„rX[A„] + 0(r2- 



-2/(l+/3)> 



a.s.. 



as n — 7- 00. Similarly, we have that 

T2 = E, 



\Yn ~\- A Jill ll^ral 



F„ + A„||(||F„ + A„| 



Y„ 



Again using the boundedness of ||A„|| and that ||Fn 



T2 = E„ 



2A„-F„+||A„f 



|r„ + A„,||(||F„ + A„|| + ||F„| 



E. 



Y 



we obtain 
+ 0(n-2/(i+/^)), a.s.. 



Y ■ A 



On applying (12. 2p to evaluate the terms E„ [ A,„] and E„ [A„ • Yn] , the leading terms in Ti and 
F„T2 cancel to give 

An+i -An = 0(||F„|r''-i(log r„||)-') + 0(n-2/(^+'^)). 

Since ||y„|| ~ i{p, (3)n^^^^~^^\ and (3 < 1, these two O(-) terms are summable, so that 
ll^n+i — ^n|| < 00, a.s., implying that An converges a.s.. □ 

Lemma 6.3. Suppose that (Al) holds with (i G N, /3 G [0,1), and p > 0. Let the Doob 
decomposition of Yn be as given at ^6. ij) . There exists a d- dimensional random vector Moo 
such that Mn Moo (1-S-, as n ^ 00. 

Proof. Taking expectations in the vector identity 1 1 Mn+i — Mn | ^ = 1 1 Mn+i | P — 1 1 M„ | ^ — 2 Af„ • 
{Mn+i — Mn) and using the martingale property, we have 

E,,[||M„+if - ||M„||2] = E,,[||M,,+i - M„f ] = E,,[||y;+i -Yn- En[Yn+i - Yn]f]. 

Expanding out the expression in the latter expectation, it follows that 

En[\\Mn+lf - \\Mnf] = En[\\Yn+l - Ynf] " (E„[f;+i - Yn]f < E„[||K„+i - F^f ]. 
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Here we have from (14. 2 p that 

2IIA. 



YMYJ-\\Y,, + AJ) + AJYJ 



< 



\Yn +A^r 



\\Y II IIF + A II 

II rt II II n ~ '—^n \ \ 

by the triangle inequahty. Since ||A„|| is uniformly bounded, and ~ £{p, (3)n^^^^'^^^ by 
Lemma EH it follows that - Y^W = 0(n"^/(i+'^)), so that 

E4||M„+if - ||M„||^] = 0(n-2/(i+«), a.s.. 

Hence En[||^n+i|P — ll^nlP] < oo, a.s., which implies that Af„ has an almost-sure 

limit, by e.g. the d- dimensional version of fiUi Theorem 5.4.9, p. 217]. □ 

Proof of Theorem \2.^ Combining Lemmas 16.21 and 16.31 with the decomposition (16. ip . we 
conclude that Yn — )■ + M^o ='■ u, for some random unit vector u, a.s., as n — ?■ oo. In 
other words, the process Yn has a limiting direction. It follows from the representation (14. 3 p 
that the processes Gn and X„ have the same limiting direction. Specifically, 



Gn = X, + J2--^\\Y,\\Y, = + 5^ -T^l^iP^ + o{l)]j^'^'^^\u + o(l)], a.s., 

i=2 ^ 3=2 ^ 

by Lemma 16.11 Hence 



Gn = [(1 + /3)^(p, /3)u + o(l)]n^/(i+^), a.s., 
and the result for X„ follows since X„ = Gn + Yn- □ 

6.3 Upper bounds: Proof of Theorem 12.41 

Theorem 12.41 will follow from the next result, which gives bounds for \\Yn\\. 

Proposition 6.1. Suppose that (Al) holds with G N, /3 > 0, and p G M. Then the 
following hounds apply. 

(i) If P > 1, then for any e > 0, a.s., for all but finitely many n G N, ||Vn|| < 
ni/2(logn)(V2)+^ 

(a) If (A2) holds, [5 = 1, and p < —{da'^/2), then for any e > 0, a.s., for all but finitely 
many n eN, \\Yn\\ < n"'^^'"' '''^"'"^ where 'j{d,a'^,p) is given by Ii2.9\) . 

(Hi) If P G [0, 1) and p < 0, then for any e > 0, a.s., for all but finitely many G N, 



\Yn\\ < (logn)i- 



To prove this result we apply some general results from [29]. Section 4 of [29] dealt with 
stochastic processes that were time-homogeneous, but that condition was not used in the 
proofs of the results that we apply here, which relied on the very general results of Section 
3 of [21]: the basic tool is Theorem 3.2 of [2U] . 

It is most convenient to again work in some generality. Again let {Zn)nm denote a 
stochastic process on [0,oo). Recall the definition of pk{n;x) from (13.11) . The next result 
gives the upper bounds that we need. Part (i) is contained in [291 Theorem 4.1(i)]. Part (ii) 
is a variation on [291 Theorem 4.3(i)] that is more suited to the present application. Part 
(iii) is also based on [22] but does not seem to have appeared before. 
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Lemma 6.4. Suppose that {Zn)nm such that Ii5. 1\) holds. 

(i) Suppose that for some A < oo, xfii{n; x) < A for all n and x sufficiently large. Then 
for any e > 0, a.s., Zn < n^^'^ilogn)'^^/'^^'^^ for all hut finitely many n G N. 

(ii) Suppose that for some V > Q and n > 1, 2xfii{n;x) < —K,fi2{'n;x) + o{l) and f^i2{n; x) > 
V for all n and x sufficiently large. Then, for any 5 > 0, a.s. Zn < n~'^^ for all but 
finitely many n E N. 

(Hi) Suppose that for some f3 G [0, 1) and A > 0, x^fii{x;n) < —A for all n and x large 
enough. Then for any e > 0, a.s., for all hut finitely many n G N, Zn < {\ogn)~^'^ . 

Proof. First we prove part (ii). Let k' = k — e for e E (0, k). Writing Dn = Zn+i — Zn, 

MZ'ntt' - Zl^^'] = Zl-^^'Eniil + (Dn/Zn))'^''' - 1] 

= (1 + ^^')Z!^ Zn) + i^f2{n; Zn) + 0{Z-')^ , 

using Taylor's formula and (15. ip . Under the conditions of part (ii), we have 

/ii(n; Zn) + 73^/i2(n; Z„) + 0{Z-^) < --^/i2(n; Zn) + o{Z~^) < 0, 

for all n and Zn large enough. Hence E„,[Z^^^ — Z}^'^'] is uniformly bounded above and the 
result follows from Theorem 3.2 of 1291. 



It remains to prove part (iii). For a > 0, define /o(x) := exp{x"}. First we show that, 
under the conditions of the lemma, for any a G (0, 1 — /3), for some C < oo, 

E„[/„(Z„+i) - f^{Zn)] < C, a.s.. (6.2) 

Writing Dn = Zn+i — Zn, we have that 

^n[fa{Zn+l) - fa{Zn)] = /a(^n)E„ [exp{(Z„ + D„)° - Z^} - 1] . 

Since Dn = 0(1) a.s., by (15. ip . Taylor's formula applied to the last expression yields 

^n[fa{Zn+l) " fa{Zn)] = /a(^n)E„ [aDnZ^-^ + 0(Zf "2)] . 

Here we have that E„[D„] < —AZ~^ for all Zn,n large enough. Since a < 1 — /3 we obtain 
(16. 2p . Now we can apply Theorem 3.2 of [29] to complete the proof. □ 

Finally we complete the proofs of Proposition 16.11 and Theorem 12.41 

Proof of Proposition \6.1[ Under the conditions of part (i) of Proposition 16. H we have from 
( 14. 5p and Lemma 14.31 that the conditions of Lemma l6.4( i) hold for Zn = ||^n||- Thus we 
obtain part (i) of the proposition. Similarly, under the conditions of part (ii), we have from 
(USD, (n and dUD that Lemma Ell^ii) holds for Z„ = and k = - J - (rf - 1), which 
is greater than 1 for p < —da'^/2. Finally, under the conditions of part (iii), we have from 
(I45|) and (gZD that Lemma E^Kiii) holds for Z„ = □ 

Proof of Theorem \2.4\ Part (i) of the theorem follows from Theorem 12.21 Parts (ii), (iii), and 
(iv) follow from Proposition 16.11 with (14. 3 p and the triangle inequality; note this introduces 
an extra logarithmic factor in the case of part (iv) of the theorem. □ 
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